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Abstract 

A two-state system (TSS) under time-periodic perturbations (to be regarded as input signals) is 
studied in connection with self-tuning (ST) of threshold and stochastic resonance (SR). By ST, we 
observe the improvement of signal-to-noise ratio (SNR) in a weak noise region. Analytic approach 
to a tuning equation reveals that SNR improvement is possible also for a large noise region and 
this is demonstrated by Monte Carlo simulations of hopping processes in a TSS. ST and SR are 
discussed from a little more physical point of energy transfer (dissipation) rate, which behaves in 
a similar way as SNR. Finally ST is considered briefly for a double- well potential system (DWPS), 
which is closely related to the TSS. 
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I. INTRODUCTION 



Recently constructive or beneficial roles of noise gather considerable interest in many 
fields, such as physical [1], and biological Q| sciences as well as engineering js]. One of the 
conspicuous effects of noise or random disturbance is that it can drive a dynamical system 
out of an equilibrium state, thus giving a life time or Kramers time [4] to (metastable) 
equilibrium states. 

Simulated annealing method^], which is used to search for solutions to minimization ( 
or more generally optimization) problems in a complex system, employs noise to prevent 
a search process from being trapped in local minimum(metastable) states. Sophisticated 
algorithms are developed to efficiently escape from local metastable states, which are useful 
for both simulated annealingand efficient Monte Carlo simulations. s| 

Stochastic resonance(SR)[l!], which stands for a phenomenon in which information trans- 
fer from input to output signals can be significantly increased by noise with appropriate 
(non-zero) intensity. One can comprehend SR by considering a simple threshold system^ 
which gives 1(0) as an output signal x if input signal s plus noise £ is larger (smaller) than 
a certain threshold value a. If an input signal s is always smaller than a and there is no 
noise, x is always equal to and information transfer through the threshold system is im- 
possible. By adding noise £ to s, there is some possibility of s + £ > a, producing x = 1 and 
information about s is conveyed through the threshold system. However large noise deforms 
original input signals too much, leading to no correlation between s and x, resulting in no 
information transfer from input to output signals. 

As a system similar to the threshold system mentioned above, let us consider an over- 
damped Brownian particle in a double-well potential driven by a sinusoidal time-periodic 
force, which was proposed and studied as a model for Earth's ice agesQ]. This model has 
an activation energy and the Gaussian Brownian noise which may be regarded as the 
threshold value a and the noise £, respectively in the threshold system. In this case informa- 
tion on input signal, such as the frequency 2nu of the sinusoidal force, is transfered as the 
peak position in the power spectrum of output signal. When the variance ( or temperature 
from the fluctuation-dissipation theorem) of £g is tuned to an appropriate value, which turns 
out to be non-zero, the signal-to-noise ratio(SNR) attains its maximum value. 

From this we may consider that SR has a close relation with synchronization, especially 



when external disturbance is characterized by a frequency /q = 2ttuq. In this regard we 
mention stochastic synchronization, in which an excitable system like neurons, responds in 
synchrony with external disturbance (signal), which also gathers lots of interest in connection 
with electroreceptors in the paddlefish(8j]. 

When input signals are subthreshold, ability of a threshold system to transfer information 
is considerably limited for weak noise, as mentioned above. To improve information transfer 
in this region, we proposed recently a simple adaptation process [9(] for a threshold value a 
hinted by a self-tuning mechanism proposed to explain auditory sensitivity [10] when input 
signal becomes very weak. 

In this paper we consider effects of self-tuning(ST) of the threshold value for a two-state 
system(TSS) driven by a sinusoidal signal. One merit of TSS is that one can calculate 
SNR accurately[ll] by solving a differential equation, without doing numerical experiments 
to obtain the power spectrum, based on which SNR is usually calculated. In Sec. [Ill we 
introduce our system, TSS and a closely related double-well potential system(DWPS) and 
propose a mechanism to control a threshold value, i.e., an activation energy. In Sec. II III 
numerical results for SNR, the probability density for residence time 12|], stochastic dynamics 
of threshold values and the firing rate for the TSS are presented. We show that large SNR is 
achieved in the small noise region as expected. In Sec. IIVI the adaptation process, which is 
governed by a threshold equation with two parameters a and (3, is studied both analytically 
and numerically. We discuss how these parameters affect quality of information transfer, 
with main emphasis put on a large noise region. Final section contains some comments 
on energy transfer rate from input signals to a reservoir and on a double well potential 
system(DWPS). 



II. MODEL 



In this section we first introduce the two-state system(TSS) [llj and relate it to the double- 
well potential system(DWPS) for convenience for later discussions on physical aspects of the 
model such as energy transfer to a reservoir. The system variable x(t) at time t is assumed 
to take only two values, x + = 1 and x_ = — 1 and transition between the two states is 
described by the master equation 

dp + {t)/dt = -w4t)p + (t)+w + (t)(l-p + (t)), (1) 



where p+(t) denotes the probability that x(t) = x + with p+(t) + p_(t) = 1. is the 

transition probability at time t for the particle to jump to the left(x_) site and w+(t) is 
similarly defined. 

The rates w + (t),W-(t) are expressed in an Arrhenius form as 

w + (t) = exp[(— a + A cos(u t))/T], 

W-(t) = exp[(— a — Aocos(u} t))/T], (2) 

where T measures strength of noise and a±A cos(uot) denotes (time dependent) activation 
energy for jumping. 

A physical system which is closely related to the TSS is a double-well potential sys- 
tem(DWPS) described by the Langevin equation 

dx/dt = —dV(x)/dx + A cos(ojot) + f(t), (3) 

where the random force f(t) satisfies the fluctuation-dissipation relation 

(f(t)f(t>))=2T5(t-t>) : (4) 
and V(x) represents the double well potential 

V(x) = a(x- l) 2 (x + l) 2 . (5) 

When both A and T are smaller than a in Eq. (J5]), Brownian particle described by Eq. (J3]) 
may be considered to stay either at x + = 1 or x_ = — 1 for time of the order of Kramers 
time tkt — exp(a/T)[4j and occasionally jumps between x + and x_. 

When the relaxation time r r ~ (8a) _1 of intrawell motion is short in the sense r r Uo 1 
one can introduce the adiabatic assumption to reduce the DWPS approximately to a two- 
state system(TSS) described by Eq. ([[]). 

Both TSS and DWPS are extensively studied in connection with SR and are known to 
show SR[l], that is, SNR shows maximum at nonzero T when other parameters charactering 
the system, such as activation energy a and Uq, A are kept fixed. It may be noted that 
for the TSS 
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121 ] analytic (or integral form) results for SNR and the distribution function 
Pf. p {r) of the first passage time for jumping to another state are available. One merit of the 
TSS is that even if we take effects of self-tuning(ST) into account, we can calculate SNR 
by solving a coupled set of differential equations Eq. ^ and Eq. ([6]), to be given below, 



without recourse to Monte Carlo simulations, which inevitably introduce fluctuations to 
power spectra and consequently to SNR. 

Here we introduce a mechanism for self-tuning(ST) of the activation energy a in Eq. 2, 



following the prescription presented in Ref. If there occurs no jumping or activation 
events, a(t) simply decreases, while if a jumping event occurs a(t) increases, thus controlling 
the jumping or firing rate by avoiding too large or too small firing rates. To express this 
adaptation process mathematically, we employ the following dynamics for a(t), 

da(t)/dt = -cra(t) + /3[w+(t)p-(t) + W-(t)p+(t)]. (6) 

Indeed, if we tentatively put ,5 = 0, a(t) goes to zero since a is chosen to be positive. If we 
put /3 positive, we notice that a(t) increases in proportion to the barrier crossing rate. By 
this mechanism we expect that the TSS adjusts a(t), reflecting the circumstances it is put 
in. 

For the DWPS we propose a similar adaptation dynamics for a(t) of the form 

/t+dt 
dtEi5(t-ti), (7) 

where U{i = 1, 2, ...) denotes the time when x(t) = 1. 

III. NUMERICAL RESULTS FOR TSS 

We first explain how one can calculate SNR for the TSS with self-tuning(ST), by slightly 



modifying the approach in Ref. 11). 



A. SNR with self-tuning: methodology 

Let us denote the solution to Eq. ([TJ and Eq. (jSj) as 

P+(t)=p+(t\x ,ao,t Q ), a(t) = a(t\x ,a ,t ), (8) 

which satisfy the initial conditions p + (t = t \xo, a , to) = 5(1, Xo) and a(t = t \xo, oo, to) = a o 
with 5(1, x) denoting the Kronecker S, i.e., 8(1, x) = 1 if x = 1 and 8(1, x) = if x ^ 1. The 
transition probability p(x, a, t\xQ, Oq, to) f° r ( ;E (t),a(t)) to be at (x,a) starting from (xq, ao) 



is expressed as 



p(x,a,t | x Q ,a ,t ) =d(a-a(t\x ,a ,t )) x 
[ p + (t\x ,a ,t )5(x - 1) 

+ (l- P+ (t\x ,a ,t ))5(x + l)}. (9) 



Following MacNamara and Wiesenfeld llj let us first introduce the time correlation func- 
tion (p(t, t\x , a , t ) by 

4>(t, t I x Q , a , t ) = (x(t)x(t + r) \x , a , to)) 
= J M J da J J dyX y P ( X , a'.t+r 
I y,a,t)p(y,a,t\x ,a ,t ). (10) 

After performing integration of Eq. ([TO]) over y and a we have 



<p(t, t | x ,a ,t ) = J da' J dxx[p + (t\x , a , to) 

p (x,a',t + T\l,a(t\x ,a ,t ),t) - p-{t\x , a ,t ) 

p (x, a',t + r| - l,a(t\x ,a ,t Q ),t)). (11) 

Now we take the limit t — » — oo to remove x , cto dependence of p+,P- and of a on the right 
hand side of Eq. (TTT!) , leading to 



, r) = J da' J dxx[p + (t)p(x, a' ,t + r|l, a(t),t) 
- p_(t)p(x,o',t + r| - l,a(t),t], (12) 

where we replace lim to ^_oop + (t|xo, ao, t ) by p+(t) and lim to ^_oo a(t|xo, cto, to) by a(t). J da' 
can be performed trivially to have 

0(t,r) = p + (t)[2p + (t + r|l,a(t),t)-l] 

- p„(t)[2p + (t + T\ - l,a(t),t) - 1}. (13) 

Finally to make the function <ft(t, r) independent of the time variable t and also to conform 
to experimental situations, we take time average (l/r p ) f Q Tp dt with t p = 2n /cj to obtain 

0(r) = (l/r p ) dt{p + (t)[2p + (t + r\l,a(t),t)-l] 



v) 
Jo 

p_{t)[2 P+ (t + r\-l,a(t),t)-l}. (14) 



Numerical implementation of Eq. f fl4|) is not difficult and the result is conveniently ex- 
pressed as 

0(r) « (j>relax{r) + 5 cos(a;or), (15) 

where 4> r eiax{^) is the relaxation part, which goes to zero asymptotically as r — > oo, and 
.B cos(o;ot) represents the periodic part of the external field. Fourier transformation of 
Eq. (115p has the form 

4>(u) = 4>relax(u) + B[5(u - LU ) + S(u + U) )), (16) 

and SNR is define here as 

RsN = B I ' 4> re lax{uo) , (17) 



B. Numerical results for SNR and other quantities 

It is noted that we take uq = 0.5 and Aq = 0.3 in the following. In Fig.l is plotted 
SNR for systems with self-tuning( a = 0.03 and /3 = 0.1, C = a/j3 = 0.3) and without self- 
tuning^ = 0.5). We observe that SNR is improved by self-tuning in the low temperature 
region. This is confirmed from the first-passage time distribution function Pf. p {r) shown in 
Fig. 2 for the two systems marked by black circle with ST and by white circle( without 
ST) in Fig.l (T = 0.15). These P/. p (t) are obtained by Monte Carlo simulations, in which 
we actually followed particle motion with the hopping rate given by Eq. (T5]) and obtain a 
histogram of the first passage time r. For a system with ST (Fig. 2a) we notice that most of 
the particles hop, taking the first chance of low activation energy. This is in contrast with 
the system without ST(Fig . 2b), for which we observe many bumps of probability with the 



spacing r p = 27r/u;n.|l2l4l4l| We discuss now the overall T-dependence of SNR shown in Fig.l 
based on time-averaged activation energy(Fig. 3a), a = r p l J^ p a(t) with r p = 2ti/ujq and on 
a time-averaged firing rate fr similarly defined as a(Fig. 3b). In the low temperature region 
(T < 0.25), the firing rate fr is increased since self-tuning(ST) lowers the activation barrier 
a(< a = 0.5). However in the high temperature region(T > 0.25) where noise intensity is 
high, SNR is deteriorated by ST due to considerable increase of a, which results in rapid 
decrease of fr compared with the fixed threshold case(Fig.3). Firing events are in general 
useful for information transfer and our results suggests that rapid growth of a as T increases 
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FIG. 1: SNR (Rsn) as a function of noise intensity T for system with(solid curve) and with- 
out(dashed curve) ST. For ST we use a = 0.03 and f3 = 0.1 in Eq. ([6]). The barrier height is set 
a = 0.5 for the system without ST. Here and hereafter coo and Aq are always set to be ojq = 0.5 
and = 0.3. 
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FIG. 2: First passage time distribution functions for the system marked by black circle(a) and by 
the white circle(b) in Fig. 1. 
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FIG. 3: Time-averaged activation energy a (a) and time-averaged firing rate fr as functions of 
T(b). Parameter values used for the solid and dashed curves correspond to the ones in Fig.l. 
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FIG. 4: Dynamical behavior x(t) = ±1 (full curves) and a{t) (dotted curves) from Monte Carlo 
simulations together with the sinusoidal signals cos(a;oi) (dashed curves) for the system marked 
by the black squares(a) and the white squares(b) with a = 0.03 and f3 = 0.1. 

is not welcome from the point of information processing by a threshold device. Behavior of 
a and fr depend on the parameters a and (3 in Eq. (j6]) and this will be considered in the 
next section. 

Before proceeding to this problem, we show a typical example of Monte Carlo trajectories 
(x(t),a(t)) together with the input signal A cos(uot) in Fig. 4a for the system marked by 
black squares(a) and white squares(b), belonging to a high T region(T = 0.4). When T 
and consequently noise are large, we have some chances of successive hopping events as 
shown in Fig. 4. In this case the activation energy a(t) increases rapidly as shown in Fig. 
4a( typically around t ~ 80) due to ST, which inhibits a firing event on average for some 
time. That is, in our Monte Carlo simulations we increase a(t) by /3 whenever there occurs a 



hopping event (see Eq. (6)). From this we intuitively see that large (3 values makes a(t) large, 
resulting in small fr(t). With these preparations we now consider a and /3 dependence of 
SNR. 



IV. THRESHOLD DYNAMICS AND SNR 



Now let us consider Eq. (JBJ), which describes time evolution of the barrier height a(t), 
and express it as 



da/dt = —aa(t) + f3fr(t), 



(18) 



where fr(t) denotes a firing rate at time t. Since we are mainly interested in a subthreshold 
situation (i.e. a(t) > A ) and a large T region where ST did not work well compared with 



the weak noise region(see Fig.l), we neglect for quai 
obtain, with a use of simple form for Kramers rate {4], 

(a/(3)a = Ca = exp(— a/T), 

after time averaging both sides of Eq. (1181) for one period r v 

5 
4 



itative discussion A /T in Eq. (j2J) and 
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FIG. 5: Time averaged activation energy a(a) and time-averaged firing rate fr(b) as functions of 
T from Eq. (19) 



field. From this we see that at large T, a — > l/C and fr — > (1 — 1/(TC)). In Fig. 5a 
we show a as a function of T, which is obtained by solving Eq. (fl9~|) for three values of 
C = a/(3(C = 0.3, 0.75, 1.0 from above). We notice that the barrier height a remains small 
even for large T when C = a /ft becomes large. The firing rate fr, calculated from Eq. ([2]) 
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FIG. 6: SNR (R SN ) with ST(a = 0.03, /3 = 0.04, C = 0.75) (full curve) and without ST(dashed 
curve) . 

1 

0.5 


-0.5 
-1 

20 40 60 80 100 120 140 
t 

FIG. 7: Dynamical behavior x(t) = ±1 (full curves) and a(t) (dotted curves) from Monte Carlo 
simulations together with the sinusoidal signals Aq cos(ujQt) (dashed curves) for the system marked 
by the white circle in Fig. 6. 

, Eq. ([6]), and Eq. f lT9|) . is shown in Fig. 5b(C = 0.3,0.75,1.0 from below). Reflecting the 
fact that a does not increase rapidly with T when C is large, the firing rate seems to remain 
large in a large T region when C becomes slightly larger than 0.3. 

Guided by this observation we choose C = 0.75( a = 0.03 and (3 = 0.04) and plot SNR 
in Fig. 6 as a function of T. Compared with the solid curve in Fig. 1 we notice that SNR is 
improved considerably and our ST seems to work well even in the high T region by choosing 
proper values for C = a/ (3. 

Details of dynamics (x(t), a(t)) are shown in Fig. 7 for the system marked with a white 
circle in Fig. 6. This should be compared with the dynamics in Fig. 4a which is characterized 




by different parameter values(o; = 0.03, (3 = 0.1, C = 0.3). By choosing a smaller value for 
/3(— 0.04) (keeping a fixed to 0.03) we could prevent the activation energy becoming too 
large and this contributes to making SNR large. 

V. ENERGY TRANSFER, DWPS AND CONCLUSION 

In this section we consider briefly energy transfer from input signals to the reservoir (i.e. 
dissipation) and the DWPS, Eqs. (3-5) before concluding this paper. 
The hopping rate, Eq. (6), can be rewritten as 

w + (t) = eM-(Vs-V 1 (t))/T], 

w.(t) = exp[-(V,-y_ 1 (*))/n (20) 

with V 3 (— a) and V±i(t) the energy at the saddle point (x = 0) and at the position x — ±1, 
respectively. If x(t) changes at t — ti from -1 to 1, the energy AE(ti) transfered from the 
signal to the reservoir is given by AE = —(Vi(ti) — V-i(t±)) = 2V_i(ii). Dividing all the 
energy ^2 i AE(t i ) by the experimental duration r exp and a, we have 

E„ r = ^AE(t i )/(T exp a), (21) 

i 

which was obtained by Monte Carlo experiments. 
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FIG. 8: Energy transfer rate E s ^ r as a function of T for s system without ST(full curve) and with 
ST with a = 0.03,/? = 0.1 (dotted curve) and a = 0.03, /3 = 0.04 (dashed curve). 

In Fig. 8 is plotted E s ^ r as a function of T. The dotted curve(a = 0.03, (3 = 0.04), the 
dashed curve(o; = 0.03, (5 = 0.1), and the full curve correspond to the systems represented by 
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FIG. 9: SNR (R SN ) for DWPS with ST(full curve) and without ST(dashed curve). For ST we 
use a = 0.05, f3 = 0.05 in Eq. (J7|) and the barrier height is set a = 1 for the system without ST 
where Aq = 0.8 and coq = 0.5. 
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FIG. 10: First passage time distribution function Pf.pir/Tp) for DWPS with ST(a) and without 
ST(b) at T = 0.15. Parameter values characterizing the system is the same with those for Fig. 9. 

the full curve in Fig. 6, the full curve in Fig. 1 and the dashed curve in Fig. 1, respectively. 
We see that SNR and E s ^ r show surprisingly similar behaviors. This is rather natural since 
both quantities depend on the firing rate and the firing timing in similar ways. Especially the 
firing timing is important for both SNR and E s ^ r . When a hopping event from x = —1 to 
x = 1 occurs at time t±, maximum energy transfer is achieved when V-\ becomes maximum 
at time t\. This synchrony is evidently reflected to SNR. As noted in Sec. I the synchrony 
is also important for SNR. 

Final comment is on the double- well potential system(DWPS), Eqs. (3-5). Since TSS 
and DWPS describe similar hopping events under time periodic signals, we expect that 



both systems share common properties , especially in relation to ST and SR. Fig. 9 shows 
SNR of DWPS with(full curve) and without (dashed curve) ST, where SNR is defined as the 
ratio P{ujq)/[P{ojq — du)/2 + P(u + du)/2] with P(uj) denoting the power spectral density 
at frequency u and duo is the frequency mesh size in numerical calculations of P{uj). This 
should be compared with Fig.l for TSS. Corresponding to Fig. 2, we compare P/. p (t) for 
the two systems marked by a white and black circle in Fig. 9. in Fig. 10. From these results 
it is seen that TSS and DWPS behave similarly with respect to response to and information 
transfer of the periodic signals. 

In this paper we applied a ST mechanism, Eq. (Q, to TSS, Eq. ([1]) and confirmed that 
better SNR is simply obtained by ST mechanism for small fluctuation(i.e. low T) region. 
Tuning of the parameters a and was guided by a simple equation (1191) . leading to better 
SNR even for a high T region. Energy transfer or dissipation rate was also studied and this 
quantity ( l2~Tj) turned out to be able to play a similar role as a measure for information 
processing ability of a threshold device. 
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